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Claims 

1. A video/audio signal processing method for processing supplied video/audio 
signals, comprising the steps of: 

describing transcoding target bitstream parameters; 

extracting transcoding hints metadata; 

!# storing the transcoding hints metadata; 

pi 

Q separating A/V material into segments; 

CI associating the transcoding hints metadata to the separated A/V segments; and 

§# . . 

."2 transcoding the A /V material. 

jL 2. A video/audio signal processing method according to claim 1, wherein the step 

0 of describing the transcoding target bitstream parameters comprises the steps of: 

Ci 

P defining a bit rate of a second bitstream of compressed images; 

m 

defining a size of pictures of the second bitstream of compressed images; 
defining a number of frames per second of the second bitstream of compressed 
images; 

defining an aspect ratio of a pel of the second bitstream of compressed images; 
defining a color depth of each of the pel of the second bitstream of compressed 
images; 

defining whether progressive format is used for the second bitstream of 
compressed images; 

defining whether interlaced format is used for the second bitstream of 
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compressed images; 

defining whether frame pictures are used for the second bitstream of compressed 
images; 

defining whether hold pictures are used for the second bitstream of compressed 
images; and 

defining a compression method of the second bitstream of compressed images. 

3. A video/audio signal processing method according to claim 2, wherein the step 
of describing the transcoding target bitstream parameters further comprises the step of 
defining employed compression standards as defined by MPEG (Moving Pictures 
Expert Group). 

4. A video/audio signal processing method according to claim 2, wherein the step 
of describing the transcoding target bitstream parameters further comprises the step of 
defining employed compression standards as defined by ITU-T (International 
Telecommunications Union Technical Standards Group). 

5. A video/audio signal processing method according to claim 1, wherein the step 
of extracting the transcoding hints metadata comprises the steps of: 

receiving a first bitstream of compressed image data having a first GOP 
structure; 

obtaining first motion information from the first bitstream; 
obtaining texture/edge information of a first segmentation; 
obtaining feature points and associated motion information from the first 
bitstream; and 
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obtaining region of interest information from the first bitstream. 

6. A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of storing the 
first motion information as transcoding hints metadata. 

7. A video/audio signal processing method according to claim 5, wherein the step 
§4y of extracting the transcoding hints metadata further comprises the step of representing 

13 motion-related transcoding hints metadata as parameters of a parametric motion model. 

© 

ill 8. A video/audio signal processing method according to claim 7, wherein the step 

|# 

of extracting the transcoding hints metadata further comprises the step of employing 
L the parametric motion model to describe a global motion within subsequent rectangular 

■im 

m video frames. 

hi 

P 9. A video/audio signal processing method according to claim 7, wherein the step 

m 

of extracting the transcoding hints metadata further comprises the step of employing 
the parametric motion model to describe a motion within a defined region of arbitrary 
shape. 

10. A video/audio signal processing method according to claim 9, wherein the 
parametric motion model is employed to describe the motion within the defined region 
of arbitrary shape as used within MPEG-4. 

11. A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of representing 
motion-related transcoding hints metadata as an array of motion vectors contained in 
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the first bitstream of the compressed image data. 

12. A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of representing 
motion-related transcoding hints metadata as an array of motion vectors derived from 
motion vectors contained in the first bitstream of the compressed image data. 

13. A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of representing 
motion-related transcoding hints metadata as a list of feature points with associated 
motion vectors, which are tracked within subsequent frames. 

14. A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of representing 
motion-related transcoding hints metadata as a list of feature points with associated 
motion vectors, which are tracked within arbitrarily shaped regions, within subsequent 
frames. 

15. A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of representing 
texture-related transcoding hints metadata as one of a list of DCT-coefficients and a 
measure (one of mean, minimum, maximum, variance, and standard deviation) derived 
thereof. 

16. A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of representing 
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edge-related transcoding hints metadata as one of a list of DCT-coefficients and a 
measure (one of mean, minimum, maximum, variance, and standard deviation) derived 
thereof 

17. , A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of representing 
the feature points and associated motion-related transcoding hints metadata as a list. 

18. A video/audio signal processing method according to claim 5, wherein the step 
of extracting the transcoding hints metadata further comprises the step of representing 
encoding-complexity-related transcoding hints metadata as a complexity metric derived 
from a life-time list of feature points tracked within subsequent frames by using a 
number of lost and new featurepoints from one frame to a next frame. 

19. A video/audio signal processing method according to claim 1, wherein the step 
of storing the transcoding hints metadata comprises the step of maintaining a buffer 
containing transcoding hints metadata for several situations. 

20. A video/audio signal processing method according to claim 19, wherein the step 
of storing the transcoding hints metadata further comprises the step of storing 
individual general transcoding hints metadata for several target devices. 

21. A video/audio signal processing method according to claim 19, wherein the step 
of storing the transcoding hints metadata further comprises the step of storing general 
transcoding hints metadata for A/V segments of varying scene activity. 

22. A video/audio signal processing method according to claim 1, wherein the step 
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of separating the A/V material into segments comprises the steps of: 

using feature points with associated motion vectors; 

tracking the feature points and keeping a life-time of feature points; and 
. determining a new A/V segment for transcoding based on a number of feature 
points that could not be tracked from one frame to a next frame. 
.23. A video/audio signal processing method according to claim 1, wherein the step 
of associating the transcoding hints metadata to the separated A/V segments comprises 
the steps of: 

calculating a number of new feature points per frame; 

determining if the number of new feature points exceeds some thresholds; and 
selecting based on said determination one of several transcoding hints states. 

24. A video/audio signal processing method according to claim 1, wherein the step 
of transcoding the A/V material comprises the steps of: 

receiving a first bitstream of compressed image data having a first GOP 
structure; 

extracting transcoding hints metadata from the first bitstream; 
utilizing the transcoding hints metadata associated to the first bitstream to 
facilitate transcoding; and 

outputting a second bitstream. 

25. A video/audio signal processing method according to claim 24, wherein the step 
of transcoding the A/V material further comprises the step of utilizing the transcoding 
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hints metadata associated to temporal segments of the first bitstream to facilitate 
transcoding. 

26. A video/audio signal processing method according to claim 24, wherein the step 
of transcoding the A/V material further comprises the step of utilizing the transcoding 
hints metadata associated to spatial segments of the first bitstream to facilitate 
|JJ transcoding. 

g 27. A video/audio signal processing method according to claim 24, wherein the step 

s r 

te, of transcoding the A/V material further comprises the step of utilizing motion 

ill information contained in the transcoding hints metadata to extrapolate second motion 

|| information for the second bitstream of compressed image data having a second GOP 

in 

© structure different from the first GOP structure. 

H 

§11 28 * A video/audio signal processing method according to claim 24, wherein the step 
of transcoding the A/V material further comprises the step of controlling a bit rate of 
the second bitstream so that a bit rate of the first bitstream is different from the bit rate 
of the second bitstream. 

29. A video/audio signal processing method according to claim 28, wherein the step 
of transcoding the A/V material further comprises the step of adjusting a size of 
pictures represented by the first bitstream so that pictures represented by the second 
bitstream exhibits a size different from the size of the pictures represented by the first 
bitstream. 

30. A video/audio signal processing method according to claim 24, wherein the step 
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of transcoding the A/V material further comprises the step of adjusting a size of 
pictures represented by the first bitstream so that pictures represented by the second 
bitstream exhibit a size different from the size of the pictures represented by the first 
bitstream. 

31. A video/audio signal processing method according to claim 30, wherein the step 
of transcoding the A/V material further comprises the step of encoding the pictures 
represented by the second bitstream as field pictures when the pictures represented by 
the first bitstream are encoded as frame pictures. 

32. A video/audio signal processing method according to claim 30, wherein the step 
of transcoding the A/V material further comprises the step of encoding the pictures 
represented by the second bitstream as frame pictures when the pictures represented 
by the first bitstream are encoded as field pictures. 

33. A video/audio signal processing method according to claim 30, wherein the step 
of transcoding the A/V material further comprises the step of interlacing the pictures 
represented by the first bitstream when the pictures represented by the first bitstream 
are received as a progressive sequence so that the pictures represented by the second 
bitstream are output as an interlaced sequence. 

34. A video/audio signal processing method according to claim 30, wherein the step 
of transcoding the A/V material further comprises the step of de-interlacing the pictures 
represented by the first bitstream when the pictures represented by the first bitstream 
are received as an interlaced sequence so that pictures represented by the second 
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bitstream are output as a progressive sequence. 

35. A video/audio signal processing method according to claim 24, wherein the step 
of transcoding the A/V material further comprises the step of encoding pictures 
represented by the second bitstream as field pictures when pictures represented by the 
first bitstream are encoded as frame pictures. 
JS 36 * A v i de <>/audio signal processing method according to claim 24, wherein the step 
fej of transcoding the A/V material further comprises the step of encoding pictures 
j % represented by the second bitstream as frame pictures when pictures represented by the 

jgj first bitstream are encoded as field pictures 

% 

fit 37 - A video/audio signal processing method according to claim 24, wherein the step 

ill 

C| of transcoding the A/V material further comprises the step of interlacing pictures 
f j represented by the first bitstream when pictures represented by the first bitstream are 

received as a progressive sequence so that pictures represented by the second bitstream 

are output as an interlaced sequence. 

38. A video/audio signal processing method according to claim 24, wherein the step 
of transcoding the A/V material further comprises the step of de-interlacing pictures 
represented by the first bitstream when pictures represented by the first bitstream are 
received as an interlaced sequence so that pictures represented by the second bitstream 
are output as a progressive sequence. 

39. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data representing pictures of a 



WO 01/69936 



PCT/JP01/01982 



44 

first size; 

extracting first motion-related transcoding hints metadata from the first 
bitstream; 

storing the first motion-related transcoding hints metadata; 

utilizing the stored first motion-related transcoding hints metadata to extrapolate 
second motion information for a second bitstream of compressed image data 
representing pictures of a second size different from the first size; and 

outputting the second bitstream. 

40. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data representing pictures 
defining an interlaced sequence; 

extracting first motion-related transcoding hints metadata from the first 
bitstream; 

storing the first motion-related transcoding hints metadata; 

utilizingthe stored first motion-related transcoding hints metadata to extrapolate 
second motion information for a second bitstream of compressed image data 
representing pictures defining a progressive sequence; and 

outputting the second bitstream. 

41. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data representing pictures 
defining a progressive sequence; 
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extracting first motion-related transcoding hints metadata from the first 
bitstream; 

storing the first motion-related transcoding hints metadata; 
utilizingthe stored first motion-related transcoding hints metadatato extrapolate 
second motion information for a second bitstream of compressed image data 
N; representing pictures defining an interlaced sequence; and 
outputting the second bitstream. 

p; 42. A transcoding method, comprising the steps of: 

§# 

igj receivinga first bitstream of compressed image data representing frame pictures; 

jp extracting first motion-related transcoding hints metadata from the first 

'$ 

bitstream; 

storing the first motion-related transcoding hints metadata; 



m 

utilizing the stored first motion-related transcoding hints metadata to extrapolate 
second motion information for a second bitstream of compressed image data 
representing field pictures; and 

outputting the second bitstream. 
43. A transcoding method, comprising the steps of: 

receivinga first bitstream of compressed image data representing field pictures; 

extracting first motion-related transcoding hints metadata from the first 
bitstream; 

storing the first motion-related transcoding hints metadata; 
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utilizing the stored first motion-related transcoding hints metadata to extrapolate 
second motion information for a second bitstream of compressed image data 
representing frame pictures; and 

outpu tting the second bitstream . 

44. A transcoding method, comprising the steps of; 

receiving a first bitstream of compressed image data representing a main image; 
extracting first motion-related transcoding hints metadata from the first 
bitstream; 

storing the first motion-related transcoding hints metadata; 

utilizingthe stored first motion-related transcoding hints metadata to extrapolate 
second motion information for a second bitstream of compressed image data 
representing a portion of the main image; and 

outputting the second bitstream. 

45. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data having a plurality of coding 
parameters including at least one of a GOP structure, a picture size, a bit rate, a frame 
picture format, a field picture format, a progressive sequence, and an interlaced 
sequence; 

extracting first motion-related transcoding hints metadata from the first 
bitstream; 

storing the first motion-related transcoding hints metadata; 
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utilizing the stored first motion-related transcoding hints metadata to extrapolate 
second motion information for a second bitstream of compressed image data having 
a plurality of coding parameters such that one or more of the coding parameters of the 
second bitstream are different from the coding parameters of the first bitstream; and 
outputting the second bitstream. 
pi, 46. A transcoding method comprising the steps of: 

jjjjj receiving a first bitstream of compressed image data representing pictures of a 

tf| first size; 

m extracting first feature point motion-rel ated transcoding hints metadata from the 

!L first bitstream; 

storing the first feature point motion-related transcoding hints metadata; 

JJJ 

f j utilizing the stored first feature point motion-related transcoding hints metadata 

m 

to extrapolate second motion information for a second bitstream of compressed image 
data representing pictures of a second size different from the first size; and 

outputting the second bitstream . 
47. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data representing pictures 
defining an interlaced sequence; 

extracting first feature point motion-related transcoding hints metadata from the 
first bitstream; 

storing the first feature point motion-related transcoding hints metadata; 
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utilizing the stored first feature point motion-related transcoding hints metadata 
to extrapolate second motion information for a second bitstream of compressed image 
data representing pictures defining a progressive sequence; and 

outputting the second bitstream. 

48. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data representing pictures 
defining a progressive sequence; 

extracting first feature point motion-related transcoding hints metadata from the 
first bitstream; 

storing the first feature point motion-related transcoding hints metadata; 

utilizing the stored first feature point motion-related transcoding hints metadata 
to extrapolate second motion information for a second bitstream of compressed image 
data representing pictures defining an interlaced sequence; and 

outputting the second bitstream; 

49. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data representing frame pictures; 
extracting first feature point motion-related transcoding hints metadata from the 
first bitstream; 

storing the first feature point motion-related transcoding hints metadata; 
utilizing the stored first feature point motion-related transcoding hints metadata 
to extrapolate second motion information for a second bitstream of compressed image 
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data representing field pictures; and 
outputting the second bitstream. 

50. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data representing field pictures; 
extracting first feature point motion-related transcoding hints metadata from the 
first bitstream; 

storing the first feature point motion-related transcoding hints metadata; 

utilizing the stored first feature point motion-related transcoding hints metadata 
to extrapolate second motion information for a second bitstream of compressed image 
data representing frame pictures; and 

outputting the second bitstream. 

51. A transcoding method, comprising the steps of: 

receiving a first bitstream of compressed image data representing a main image; 
extracting first feature point motion-related transcoding hints metadata from the first 
bitstream; 

storing the first feature point motion-related transcoding hints metadata; 

utilizing the stored first feature point motion-related transcoding hints metadata 
to extrapolate second motion information for a second bitstream of compressed image 
data representing a portion of the main image; and 

outputting the second bitstream. 

52. A transcoding method, comprising the steps of: 
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receiving a first bitstream of compressed image data having a plurality of coding 
parameters including at least one of a GOP structure, a picture size, a bit rate, a frame 
picture format, a field picture format, a progressive sequence, and an interlaced 
sequence; 

extracting first feature point motion-related transcoding hints metadata from the 
first bitstream; 

storing the first feature point motion-related transcoding hints metadata; 

utilizingthe stored first feature point motion-related transcoding hints metadata 
to extrapolate second motion information for a second bitstream of compressed image 
data having a plurality of coding parameters such that one or more of the coding 
parameters of the second bitstream are different from the coding parameters of the first 
bitstream; and 

outputting the second bitstream. 

53. A video processing method for processing supplied video signals, comprising 
the steps of: 

receiving a source video; and 

classifying contents of the source video using one of motion metadata, 
texture/edge metadata, and feature points and associated motion metadata, including 
a number of new feature points per frame, 

54. A video processing method according to claim 53, wherein said method is used 
for determining transcoding parameters settings of a transcode. 
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55. A video processing method according to claim 53, wherein said method is used 
for organizing audiovisual material based on the classification of the contents of the 
source video. 

56. An apparatus for processing supplied video/audio signals, comprising: 

a target buffer for storing at least one description of transcoding target bitstream 
parameters; 

S3 

jP an extraction unit for extracting transcoding hints metadata based on the at least 

Q 

€1 one description; 

Uk 

5 -si 

Ej a buffer for storing the transcoding hints metadata; 

P a segmenting unit for separating A/V materia] into segments; and 

m 

|l a transcoding unit for associating the transcoding hints metadata to the separated 

Q A/V segments and transcoding the A/V material . 

Ill 

57. A transcoding apparatus, comprising: 

an input for receiving a first bitstream of compressed image data representing 
pictures of a first size; 

a transcoding hints metadata extraction unit for extracting transcoding hints 
metadata from the first bitstream; 

a buffer for storing the transcoding hints metadata; 

a processing unit for utilizing the stored transcoding hints metadata to 
extrapolate motion information for a second bitstream of compressed image data 
different from the first bitstream; and 
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an output for outputling the second bitstream. 
58. An apparatus for processing supplied video signals, comprising: 
an input for receiving a source video; and 

a processor for classifying contents of the source video using one of motion 
metadata, texture/edge metadata, and feature points and associated motion metadata, 
including a number of new feature points per frame. 



